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BACKGROUND OF THE INVENTION 

1 . Field of the invention 

The invention pertains generally to the field of interactive television systems. More 
particularly, the present invention is drawn to methods and systems for enabling users to 
5 easily customize and manage virtually all forms of electronic communications including, for 
example, all television, video recording, videoconferencing and Internet-related activities. 

2. Description of the Related Art 

q Conventional broadcast or cable television generally is limited to the transfer of 

m information from a content provider to the user. Interactive television, although long 

^ 10 forecasted, has thus far failed to materialize as a commercially viable product. In its most 
H basic form, interactive television (hereafter " interactive TV") includes a TV system in which 

Q the flow of information is or can be bidirectional. Generally, conventional interactive TV 

M enables the viewer to interact at some level with the TV and offers an enhanced level of 

P service to the user, which may include video on demand, games and home shopping and 

15 banking. Moreover, interactive TV has come to include such functions as PVRs, or personal 
video recorders, which combine a large storage capacity with a user interface to enable the 
user to digitally record and playback selected TV shows or events. By significantly 
simplifying the process of selecting and recording television programs, PVRs have 
accelerated the trend initiated by the videocassette recorder (VCR) toward time shifted 
20 viewing; that is, viewing a previously recorded program at the user's convenience rather than 
at a schedule dictated by the content provider. 

However, current PVRs are believed to be limited in their functionality as they are 
essentially limited to recording live television and providing the user with access to a number 
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of services such as weather, financial information, TV guide, etc. Conventional interactive 
TV devices such as those marketed by Tivo, Inc. are believed to be somewhat limited to 
rendering whatever video stream is provided by the content provider on the user's television 
screen. In many cases, early so-called interactive TV devices are little more than 
conventional TV receivers onto which digital decoders and mass storage devices have been 
grafted. Moreover, such devices inherently provide (often by design) the content provider 
with a great deal of information concerning the user's viewing habits and the nature of the 
information selected by the user. What is needed, therefore, is to provide an improved an 
interactive TV device that affords the user with complete privacy in his or her choice of 
content and the manner in which such content is viewed, processed and stored. What is also 
needed is an interactive TV device having a very large bandwidth and processing power, to 
enable it to receive and process multiple broadband input streams simultaneously. Also 
needed are devices and systems to provide the user with the means for practical, reliable and 
high quality full motion videoconferencing for personal, e-commerce applications, gaming 
and entertainment purposes. 

SUMMARY OF THE INVENTION 

It is an object of the present invention, therefore, to provide an improved interactive 
TV device. It is another object of the present invention to provide an interactive TV device 
having a very large bandwidth and processing power, to enable it to receive and process 
multiple broadband input streams simultaneously. Another object of the present invention is 
to provide the user with the means for practical, reliable and high quality full motion 
videoconferencing for personal, e-commerce applications, gaming and entertainment 
purposes. 
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In accordance with the above-described objects and those that will be mentioned and 
will become apparent below, an interactive TV device, according to an embodiment of the 
present invention, comprises an input, the input being configured to accept a plurality of 
5 input streams; an output, the output being configured to selectively output a plurality of 
output streams; a first digital bus connected between the input and output, the first digital bus 
being uninterrupted between the input and the output; an analog bus connected between the 
input and the output, the analog bus including a video signal decoder coupled to the input 
and a video signal encoder coupled to the output, and a graphics processing assembly coupled 
i]5 10 to the first digital bus and to the analog bus. 

According to further embodiments, the input may be configured to accept an input 
m stream selected from an analog video source, a digital video source, an IP connection, a video 

a stream from a data carrier, a video stream from a video camera, an IR connection, a wireless 

KI connection, a Universal Serial Bus (USB) - compatible port and/or the output of the 

^ 15 interactive TV device, for example. The output may be configured to selectively output a 
^ video stream to a plurality of TV outputs, a disk recorder, to the input of the device, to a 

network, to a Universal Serial Bus-compatible port, to a SCART-compatible port and/or to a 
computer display, for example. The digital bus may be configured as a Digital Video Bus 
(DVB), for example. The input may further include an input multiplexer coupled to the 
20 input, the input multiplexer being configured to selectively route at least one of the plurality 
of input video streams onto the digital bus and/or the analog bus. The output may further 
include an output multiplexer coupled to the output, the output multiplexer being configured 
to selectively route at least one video signal from the digital bus and/or the analog bus to the 
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output. The video signal encoder may include a PAL or NTSC or SECAM decoder and the 
video signal decoder may include an HDTV or PAL or NTSC or SECAM decoder. The 
device may further include memory and disk storage, the memory and the disk storage being 
accessible via a command bus coupled to the input, the output and to the graphics processing 
assembly. The disk storage may include a magnetic hard disk and/or an optical disk reader 
and recorder, for example. The device may also include a watchdog processor, the watchdog 
processor being coupled to the analog bus and the command bus. The watchdog may be 
configured to monitor the state of the device and to monitor and regulate traffic at least on the 
analog and command buses. 

The graphics processing assembly may include a first graphics engine and a second 
graphics engine. The first graphics engine may include a hardware video encoder and a 
hardware video decoder, both the video encoder and decoder being coupled to the digital bus 
and to the analog bus. The hardware video encoder and the hardware video decoder may 
conform to a Motion Pictures Expert Group (MPEG) standard (such as the MPEG2 or 
MPEG4 standards, for example). The device may further include a Central Processing Unit 
(CPU) coupled between the output of the video encoder and the input of the video decoder, 
the CPU also being coupled to the digital bus. The second graphics engine may include a 
graphics processor coupled to the CPU. The graphics processing assembly further may 
include a video controller coupled to the CPU and the output. 

The present interactive TV device may further include an integrated video camera. 
The video camera may be configured to automatically track a person. The interactive TV 
device may include an auto-tracking analog controller configured to control the integrated 
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video camera using analog signals from a videocomposite signal generated by the integrated 
video camera. The auto-tracking analog controller may include means for separating scan 
lines signals and frames signals from the videocomposite signal; a horizontal displacement 
controller configured to generate a move left signal and a move right signal from the scan 
lines signals and the videocomposite signal to control right and left movement of the 
integrated video camera, and a vertical displacement controller configured to generate a move 
up signal and a move down signal from the frames signals and the videocomposite signal to 
control up and down movement of the integrated video camera. The horizontal displacement 
controller may be configured to carry out a comparison of a current horizontal position of the 
person as determined from the scan lines signal and the videocomposite signal with a 
previous horizontal position of the person and to selectively output either the move right 
signal or the move left signal depending upon the result of the comparison. The vertical 
displacement controller may be configured to carry out a comparison of a current vertical 
position of the person as determined from the frame lines signal and the videocomposite 
signal with a previous vertical position of the person and to selectively output either the move 
up signal or the move down signal depending upon the result of the comparison. 

A removable cover may be fitted over the front face of the interactive TV device to 
physically obscure the field of view of the camera (for privacy, for example). The interactive 
TV device may further include or be connectable to a smart card reader and/or a magnetic 
card reader. The device may be further be configured to connect to a keyboard, a pointing 
device and/or other input devices. The present device may also include one or more 
microphones. 
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The present interactive TV device may be configured to retrieve a list of available 
service and content providers from a remote server over a network, based upon a localization 
indicium supplied to the remote server(s). The localization indicium may be an area code of 
a region in which the device may be located, a geographical coordinate obtained from Global 
Positioning Satellites or an indication of a present time and time zone, to name a few 
examples. 

The device may be configured to treat all incoming video streams as a channel that is 
accessible to a user in a same manner as a television channel The device may be configured 
to be connected to a display, and the device may be configured to display incoming signals 
either in a full screen format or in a format including up to four independent quarter screen 
segments on the display. The device may be configured to be connected to a display defined 
by four sides, the device being configured to selectively display four pull out strips, each pull 
out strip of the four originating from a respective one of the four sides of the display, each 
pull out strip displaying at least one of icons and channel logos. At least one of the channel 
logos may be or include an image of a user (such as a picture of the user's face). A removable 
drawer may be provided that includes a plurality of electronic modules, the removable drawer 
being configured to electrically couple selected one of the plurality of electronic modules to 
the command bus, the analog bus and/or the digital bus. 

The device may further include means for recording incoming analog or digital video 
streams and for storing the recorded video streams on the disk storage. The device may be 
configured to maintain a recording library database that includes a record for each recording 
created by the interactive TV device. The recording library database may store, for each 
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recording, one or more of the following: the name of the recording, a description of the 
recording, the location of the recording on the disk storage the date of the recording, the time 
of the recording, the duration of the recording, the channel from which the recording was 
made, an identification of a user having made the recording, the type of recording and the 
password associated with the recording (if any). The device may further include means for 
Web browsing and/or means for composing and managing email. 

According to another embodiment thereof, the present invention is also an interactive 
television device configured to display four selectively viewable pull out strips on a display, 
each pull out strip originating from a respective one of the four sides of the display and 
extending toward an opposite one of the four sides, each pull out strip displaying at least one 
of icons and channel logos. Each of the four pull out strip may be configured to be pulled 
out from one of the four sides of the display upon selection by an input device, each of the 
four pull out strip farther being configured to be out of view when not selected or in use. At 
least one of the four pull out strips may be scrollable. One of the channel logos may include 
an image of a user, the selection of which invoking a user management general module 
configured to enable the creation, modification and/or deletion of a user and a user profile. 
The user profile may include one or more of the following: a unique user identification 
number; a user logo, the user logo including an image of the user; an identification of a last 
channel selected by the user; a number of channels defined for the user; a channel table, the 
channel table including a list of channels assigned to the user; a personal password of the 
user, a default recording quality for recordings made for the user, and an applications table 
for the user, the application table defining access rights for the user to the applications loaded 
onto the interactive TV device and/or a location of user and application-specific data. The 



Page 8 of 70 



WEBE5753 



device may be further configured to display incoming signals either in a full screen format or 
in a format that includes up to four independent quarter screen segments on the display. 

The present invention, according to another embodiment thereof is also a system for 
interactive television, comprising at a first location: a first interactive TV device, the 
5 interactive TV device including a first integrated auto-tracking video camera, and a first 
display coupled to the interactive TV device; and at a second location remote from the first 
location: a standalone auto-tracking video camera or a second interactive TV device 
including a second integrated auto-tracking video camera, and a second display coupled to 
the standalone auto-tracking video camera or the second interactive TV device, and a network 
'5 10 coupling the first interactive TV device to the standalone auto- tracking video camera or the 
lily second interactive TV device. The first and second integrated video cameras and the 

m standalone video camera may each derive auto-tracking signals from analog videocomposite 

^ signals. 

;' 

U The present invention, according to another embodiment thereof, is a video camera 

\ i 

0 15 system for videoconferencing applications comprising a video camera, the video camera 
including a circular base; an elongated body coupled to the base, and a head supported away 
from the base by the body, the head including a video camera movable along an X and a Y- 
axis, motors for moving the video camera along the X and Y-axes and at least one 
microphone. The base may include a connector for power, video signals and/or control 
20 signals. The body may be removably coupled to the base. The video camera may further 
include one or more rings disposed between the base and the body, each ring being 
configured to carry out a predetermined function. One of the rings may include a battery to 
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power the video camera. One of the rings may include an electric motor and a controller 
coupled to the electric motor for rotating the camera along the X-axis. One of the rings may 
include wireless communication means. One of the rings may include means for processing 
an analog and/or a digital video stream. One of the rings may include a processor configured 
to run a multipoint videoconferencing application. The body may include an infrared (IR) 
sensor and/or one or more antennas. 

The video camera may be configured to automatically track a target, such as a person. 
The video camera may further include an auto-tracking analog controller configured to 
control the video camera using analog signals derived from a videocomposite signal 
generated by the video camera. The auto-tracking analog controller may include means for 
separating scan lines signals and frames signals from the videocomposite signal; a horizontal 
displacement controller configured to generate a move left signal and a move right signal 
from the scan lines signals and the videocomposite signal to control right and left movement 
of the integrated video camera, and a vertical displacement controller configured to generate 
a move up signal and a move down signal from the frames signals and the videocomposite 
signal to control up and down movement of the integrated video camera. The horizontal 
displacement controller may be configured to carry out a comparison of a current horizontal 
position of the person as determined from the scan lines signal and the videocomposite signal 
with a previous horizontal position of the person and to selectively output either the move 
right signal or the move left signal depending upon the result of the comparison. The vertical 
displacement controller may be configured to carry out a comparison of a current vertical 
position of the person as determined from the frame lines signal and the videocomposite 
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signal with a previous vertical position of the person and to selectively output either the move 
up signal or the move down signal depending upon the result of the comparison. 

The video camera may further include signal processing means, including an input, 
the input being configured to accept a plurality of input streams; an output, the output being 
5 configured to selectively output a plurality of output streams; a first digital bus connected 
between the input and output, the first digital bus being uninterrupted between the input and 
the output; an analog bus connected between the input and the output, the analog bus 
including a video signal decoder coupled to the input and a video signal encoder coupled to 
the output, and a graphics processing assembly coupled to the first digital bus and to the 
% 10 analog bus. The input may be configured to accept an input stream selected from a video 
W camera, an analog video source, a digital video source, an IP connection, an IR connection 

W and/or an output of the video camera, for example. The output may be configured to 

m selectively output a video stream to a plurality of TV outputs, a modem, wireless data port, to 

|S a San IR connection and/or to the input of the video camera, for example. The digital bus 

y 1 5 may be configured as a Digital Video Bus (DVB), for example. The input may further include 
^ an input multiplexer coupled to the input, the input multiplexer being configured to 

selectively route at least one of the plurality of input video streams onto the digital bus and/or 
the analog bus. The output may further include an output multiplexer coupled to the output, 
the output multiplexer being configured to selectively route at least one video signal from at 
20 least one of the digital bus and the analog bus to the output. The video signal encoder may 
include at least one of a PAL, NTSC and SECAM decoder and the video signal decoder may 
include at least one of an HDTV, PAL, NTSC and SECAM decoder. The video camera 
system may further include memory and disk storage, the memory and the disk storage being 
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accessible via a command bus that may be coupled to the input, the output and to the graphics 

processing assembly. The video camera system may further include a main input/output (I/O) 

processor, the main I/O control processor being coupled to the analog bus and the command 

bus and being configured to monitor the state of the device and to monitor and regulate traffic 

on the analog and command buses. The graphics processing assembly may include a 

hardware video encoder and a hardware video decoder, both the video encoder and decoder 

being coupled to the digital bus and to the analog bus. The hardware video encoder and the 

hardware video decoder may conform to a Motion Pictures Expert Group (MPEG) standard, 

for example. The video camera may further include a Central Processing Unit (CPU) coupled 

between an output of the video encoder and an input of the video decoder, the CPU also 

being coupled to the digital bus. 

The video camera may further include means for gross targeting of a target, such as a 

person. The video camera further may include an infrared receiver for receiving a selected 

and coded infrared signal and the system may further include an electronic tag configured to 

be worn on a person, the electronic tag including an infrared signal generator configured to 

generate the selected and coded infrared signal to enable the video camera to grossly target 

the person. The electronic tag further may include one or more microphones. 

The foregoing and other features of the invention are described in detail below and set 
forth in the appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a further understanding of the objects and advantages of the present invention, 
reference should be made to the following detailed description, taken in conjunction with the 
accompanying figures, in which: 
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Fig. 1 is a block diagram of the signal processing circuitry of an interactive TV device 
according to an embodiment of the present invention. 

Fig. 2 represents an alternate view of a portion of the block diagram of Fig. 1, to 
illustrate further aspects of the present invention. 

Fig. 3 is a block diagram of the signal processing circuitry of a standalone auto- 
tracking videoconferencing camera suitable for use alone or in conjunction with the present 
interactive TV device, according to a further embodiment of the present invention. 

Fig. 4 is a perspective view of a standalone auto-tracking videoconferencing camera 
suitable for use alone or in conjunction with the interactive TV device of the present 
invention. 

Fig. 5 is a block diagram illustrating the manner in which various sources of 
information are presented to and acquired by the interactive TV device of the present 
invention, among other aspects. 

Fig. 6 shows a block diagram of the video signal processing circuitry an analog auto- 
tracking camera suitable for use in the present invention. 

Fig. 7 illustrates a videocomposite signal. 

Fig. 8 shows an embodiment of the user interface of an interactive TV device, 
according to an embodiment of the present invention. 

Fig. 9 shows an example of a pull out strip, according to an embodiment of the 
present invention. 
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Fig. 10 shows an example of a pull out strip configured to manage users and user 
profiles, according to an embodiment of the present invention. 

Fig. 1 1 is a functional block diagram showing the main elements of the controlling 
software of the present interactive TV device. 

5 Fig. 12 is a functional block diagram of the "Home" application that is configured to 

manage many of the functions of the present interactive TV device, according to further 
aspects of the present invention. 

Fig. 13 shows an example of a videoconference utilizing the present interactive TV 
device and/or the present auto-tracking videoconferencing camera, according to the present 
10 invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 is a block diagram of the video signal processing circuitry 100 of the interactive 
TV device according to an embodiment of the present invention. The present interactive TV 
device may best be thought of as a multi input data flow receiver. Indeed, the device signal 

15 processing circuitry 100 includes functionality to perform as a Web browser, HF, cable and 
satellite TV receiver, a digital PVR, an interactive TV set-top box, an advanced central 
processing unit and a videoconferencing device, thanks to an integrated videoconferencing 
camera. According to the present invention, all multimedia sources are treated and managed 
identically, whether the input is a TV channel (such as CNN®, for example) or a Web page 

20 (such as www.yahoo.com), etc. Moreover, the present interactive TV device also includes 
the ability to watch and record a plurality of MPEGx (Motion Pictures Expert Group) such as 
MPEG2 or the emerging MPEG4 protocol) video streams simultaneously. The present 
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interactive TV device is designed with an architecture that is able to manage several data 
streams simultaneously. For example, the information input to the signal processing circuitry 
100 (from whatever source) of the present interactive TV device may be displayed on four 
independently manageable quarter screen segments 802a, 802b, 802c and 802d, such as 
shown in Fig. 8. The interactive TV device of the present invention, a physical embodiment 
of which is depicted in Fig. 5 at reference numeral 502, may be deployed in tandem with the 
standalone videoconferencing camera 400 shown in Fig. 4 to create a flexible and powerful 
multi-point real time, full motion and secure (when the generated video streams are 
encrypted) videoconferencing system. Alternatively several interactive TV devices 502 may 
be coupled across a network to enable two or more users to carry out a videoconference. 

Returning now to Fig. 1, the signal processing circuitry 100 of the interactive TV 
device includes a plurality of inputs, collectively referenced by 102. These inputs may 
include a HF satellite input 104, a HF cable input 106, and analog tuner 108, an Audio/Visual 
input 110, a multiplexer (Mux) in return input 111, a Universal Serial Bus (USB) input 114, 
an Asymmetric Digital Subscriber Line (ADSL) input 116 and/or other broadband connection 
to a network (including, for example, the Internet), an Infrared input and/or a Blue Tooth 
compatible input 118 (a communication and computing standard allowing high bandwidth, 
short range communications using a wireless connection; additional information on this 
specification may be obtained from www.bluetooth.com), a Digital Versatile Disk (DVD) 
input 120, an input for a video camera (such as shown at 504 in Figs. 4 and 5) and an input 
for a waiting image 124 (a waiting image is an image that is displayed to the user while the 
system starts, such as "Please wait, system loading... 11 ), for example. Other inputs and/or 
devices configured to feed audio and/or video streams into the circuitry 100 may also be 
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interfaced with and/or added to the input 102. Inputs 104-124 (and/or any other inputs that 
may be present at 102) may be multiplexed by input mux 126 onto one of three buses 128, 
138 and 150. Bus 128 is a digital bus configured to deliver digital audio and video (AV) 
signals. For example, the bus 128 may conform to the Digital Video Broadcasting (DVB) 
standard. DVB is a standard that utilizes the MPEG2 compression standard for transmission 
of digital video and audio. Further information concerning the DVB standard may be found 
at www.dvb.org . The digital bus 128 is preferably provided directly between the input mux 
126 and the output mux 168, as shown. In effect, this digital AV bus 138 provides an 
uninterrupted path for a digital video stream from the input 102 to the output 109, to thereby 
provide the ability to render a video stream in full screen mode without any degradation in 
picture quality (i.e., without degradation of the signal-to-noise (S/N) ratio). Indeed, as the 
video stream may traverse the entire interactive TV device without perturbations (without 
needing to propagate through an intervening device), the present interactive TV device is 
functionally invisible within the context of full screen viewing. 

The present interactive TV device may also be provided with an analog AV bus, 
referenced as AV Bus 138. As shown, a video signal (from whatever source) may be 
multiplexed by mux 126 to the AV Bus 138, whereupon it may be fed to one of a plurality of 
video decoders coupled to the analog AV bus 138, such as the video decoder 130. The video 
decoder 130 may include a PAL, SEC AM and/or NTCS decoder, for example. One current 
implementation of the signal processing circuitry 100 of the present interactive TV device 
utilizes the SAA71 14 decoder manufactured by Philips Semiconductors, Inc. The SAA71 14 
is a multistandard 9-bit digital video decoder/sealer with a four-line comb filter. Other 
suitable decoders may also be used, as those of skill will readily recognize. A plurality of 
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HDTV, PAL, NTSC and/or SECAM video encoders may also be provided on the AV Bus 
138, as shown at 152, which video encoders 152 are also coupled to the output multiplexer 
168. 

A third high speed bus such as the Command Bus (CB) 150 may be provided to 
interconnect various processing and storage elements with the decoders 130 and the encoders 
152, among other devices. Such a bus 150 may include busses that conform to the Peripheral 
Component Interconnect (PCI) standard, the IC2 standard and/or some other bus architecture. 
A bridge 140 may interconnect each of the video encoders 152 and the bus 150, while bridge 
158 may interconnect each of the video encoders 152 and the bus 150. A number of devices 
may be connected to the bus 150, such as one or more disk storage devices 166 (such as an 
Integrated Device Electronics (IDE) magnetic disk drive or drives, for example) and/or other 
devices such as a Digital Signal Processor (DSP) such as the Texas Instruments TMS320 line 
of DSPs, for example. Memory 164, such as Dynamic Random Access Memory (DRAM) or 
static RAM (SRAM) may also be coupled to the bus 150. For example, the circuitry 100 may 
include 512 Mb (or more) of DRAM memory. The disk storage 166 may include, for 
example, 100 Gbytes of storage space, enabling between about 100 and 300 hours of video 
recording, depending upon the quality of recording. The interactive TV device, moreover, 
may include appropriate connectors to enable the user to connect external storage devices 
(whether magnetic or optical, for example), for virtually unlimited space. 

Preferably, the compression and decompression of video streams into and from the 
MPEGx standard is carried out in hardware, thereby enabling a more efficient use of 
processor resources and encoding and decoding functions that are independent of the current 
processing load on the internal processor 146 of the circuitry 100. Toward that end, a 
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graphics processing assembly 190 is preferably coupled at least to the AV Bus 138 and to the 
digital AV bus 138. The graphics processing assembly 190 may include a first graphics 
engine 192 and a second graphics engine 148. The first graphics engine 192 may include, for 
example, one or more (MPEGx, for example, where x = 1, 2 or 4) video encoders 144 
5 coupled to a Central Processing Unit (CPU) 146, which CPU 146 is coupled to one or more 
(MPEGx, for example) video decoders 154. For example, the video encoder(s) 144 may 
incorporate a single-chip solution, such as the CXD1922Q MPEG2 encoder manufactured by 
Sony Corp., for example. The CPU 146 may be a Pentium class processor (such as a 
Pentium EI or higher), as manufactured by Intel Corporation, for example. The second 

Q 

J3 10 graphics engine 148 may be closely coupled to the bus 150. A current implementation of the 

*5 

W second graphics engine 148 includes the SIS630 Chipset from Silicon Integrated Systems 

m 

^ Corporation, which includes, among other features, a 2-D and 3-D graphics accelerator, an 

IDE controller, a bridge to the bus 150, a DVD accelerator and support for a variety of video 

m streams and display devices. A video controller 156 may be coupled to the bus 150 and to 

15 the output mux 168. The video controller 156 is also preferably coupled to the CPU 146 via 

^ a bus that is optimized to handle graphics and/or video streams, such as a bus conforming to 

the AGP specification, for example (AGP, or Advanced Graphics Port, is an interface 
specification introduced by Intel Corporation to speed up the rendering of complex 3-D 
computer graphics). The video controller 156 may be selected from among the VGA 
20 controllers manufactured by nVidia Corporation, for example. The video controller 156 may 
take any video and/or graphics signal presented to the output multiplexer 168 and deliver it to 
the Command Bus 150, where is may be processed and/or stored, such as on the disk storage 
166. 
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A "watchdog" processor 134 may be coupled between the AV bus 138 and the 
Command bus 150. Coupled between the watchdog processor 134 and the AV Bus 138 is a 
bus interface 132, which performs all required operations to enable the watchdog processor to 
access and control the video signal on the AV Bus 138. Similarly, coupled between the 
5 watchdog processor 134 and the Command Bus 150 is another bus interface 136, which 
provides all of the bidirectional bus translator functions necessary for the watchdog processor 
134 to access and control the video signal flow on the Command Bus 150, and to enable the 
watchdog processor 134 to access the memory 164 and/or the disk storage 166. For example, 
the bus interface 136 may include, for example, the EC210 PCI Bus Master / Target device 

3 10 manufactured by Altera Corporation. The watchdog processor 134 is preferably independent 

, 

W of either the CPU 146 or the DSP 162. The principal function of the watchdog processor 134 

U is to monitor the state of the present interactive TV device. In particular, the watchdog 

I* processor 134, under the control of the watchdog general module 1104 (see Fig. 11) may be 

i| configured and programmed to monitor and insure the proper functioning of the present 

\i 15 interactive TV device. For example, the watchdog processor 134 may monitor the internal 
^ temperature of the device (to optimize the operation of internal fans to conserve energy and 

reduce the device acoustics, among other reasons) and/or other internal parameters, may 
detect and manage operating modes (sleep, and/or wake up operating modes, for example), 
may detect the presence of devices and/or signals, and may monitor the camera (see reference 
20 504 in Figs. 4 and 5) integrated within the present interactive TV device. The watchdog 
processor 134 may also carry out control functions such as insuring the continued 
confidentiality of user passwords, managing user profiles, verifying the authenticity and 
integrity of installed and currently running programs and provide verification of all devices 
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coupled to the present interactive TV device. The watchdog processor 134 may also perform 
calculations relative to and monitor the load present on the internal buses within the circuitry 
100 (such as the AV Bus 138 and the Command bus 150, for example). The watchdog 
processor 134 may also generate alarms, in cooperation with various applications, when one 
of the buses 138 or 150 becomes overloaded. Moreover, the watchdog processor 134 may be 
configured to discharge or otherwise interrupt a video signal that overloads a given bus. For 
example, the watchdog processor 134 may exert control over the Command Bus 150. Other 
functions of the watchdog processor 134 include monitoring the integrity of the operating 
system and to re-load the operating system of the present interactive TV device (such as the 
Linux operating system, for example) from the network 510 (see Fig. 5) or directly from a 
data carrier such as a DVD-ROM or CD-ROM while maintaining user-related parameters. 

At least the DVB Bus 128, the output of the encoder(s) 152, the bus 150 and the video 
controller 156, as shown in Fig. 1, may be coupled to an output mux 168 that is configured to 
selectively route the signals on the aforementioned buses to a number of outputs collectively 
shown at 109. The outputs 109 shown in Fig. 1 are but a representative few of the possible 
outputs of the interactive TV device according to the present invention. These outputs 109 
may include a plurality of independent TV outputs 112 (such as four independent TV outputs, 
for example), a Y/C video out 1 14 (Y being luminance and C being chrominance - also called 
S-video), a SCART (Syndicat des Constructeurs d'Appareils Radio et Television), used for 

combined audio and video connections - also known as Euroconnector) output 116, a MUX 
in return 178, a Universal Serial Bus (USB, IEEE1394) output, an ADSL output 182, an IR 
I2C compatible output (a two-wire serial bus licensed by Royal Philips Electronics), a DVD- 
RAM or DVD-Recordable output 186 and, for example, a Modem (such as a 56K modem, 
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for example). Other outputs may be provided to in addition to (or substituted for) the outputs 
109 shown in Fig. 1, as those of skill may recognize. 

The shaded elements of the block diagram of Fig. 1 may be configured to be modular 
and removable, and may be includes as part of a removable drawer configured to fit within 
the present interactive TV device. Other and/or additional electronic modules may be 
incorporated in the removable drawer, to provide the user with the ability to customize and/or 
upgrade the capabilities of the present interactive TV device. The removable drawer enables 
the electrical coupling of selected ones of the electronic modules to the command bus 150, 
the analog bus 138 and/or the digital bus 128. Such modularity enables the present 
interactive TV device to resist obsolescence by adapting and incorporating to new 
technologies as they become available. 

Fig. 2 represents an alternate view of a portion of the block diagram of Fig. 1, to 
illustrate the manner in which the interactive TV device of the present invention treats an IP 
connection in a manner that is similar to a television channel - that is, every http address may 
be seen and treated as a television channel. As shown therein, an Internet (IP) connection 
202 is processed by the CPU 146 (and rendered on a display via a Web browser, for 
example). The output of the CPU 146 may be simultaneously fed to the video controller 156 
(a VGA video controller, for example) and to the second graphics engine 148 (such as the 
previously mentioned SIS630, for example). Both the second graphics engine 148 and the 
video controller 156 may be coupled to video memory 206 and 204, respectively. The video 
memories 206 and 204 are not shown in Fig. 1. The stream originating from the Internet 
connection 202 may be processed by, for example, the second graphics engine 148, output to 
the output multiplexer 168, fed back to the input multiplexer 126 via the MUX in return 118 
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and the output MUX 168 and thereafter loaded onto the AV Bus (for example) and processed 
in the same manner (such as a TV signal) as any other input to the interactive TV device. 
The present invention, in this manner, may treat all internal data flows as a video or 
television channel and may be configured to render all such data flows (irrespective of the 
content, source or format thereof) as a video channel on the display(s) 508, such as shown in 
Fig. 5. 

By providing digital buses 128 (which is uninterrupted from the input to the output of 
the device) and 150 and one analog bus 138 and two separate and independent processors 146 
and 148, a large amount of data may be processed and displayed simultaneously. By 
providing such high bandwidth and such robust processing power, many of the functionalities 
once relegated to the content provider may now be carried out internally to the present 
interactive TV device. For example, the user's choice of programming may now be 
transparent to the content provider, as the present interactive TV device may simultaneously 
receive a great deal of information (i.e., multiple data streams) from which the user may 
select his or her choice of programming and/or content. In effect, the user's choice of content 
need not influence what content is actually input into the present interactive TV device, 
thereby insuring the user's privacy. The user, in this manner, may view any content accessed 
by the device without necessarily informing the content provider of what and when the 
content is viewed. Moreover, all of the channel settings, device settings, user information 
and user profiles and preferences may remain confidential and internal to the present 
interactive TV device and need not be transmitted to an external server for further storage, 
processing, data mining and possible unwanted targeted marketing. 
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Fig. 3 is a block diagram of the video signal processing circuitry 300 of the auto- 
tracking videoconferencing camera such as shown at 400 in Fig. 4, according to an 
embodiment of the present invention. As shown therein, the signal processing circuitry 300 
of the present auto-tracking videoconferencing camera 400 is similar to that of the present 
interactive TV device, in that it is based upon a digital audio video bus (DVB) 306 
(uninterrupted between the input 302 and the output 304 of the camera by way of input and 
output multiplexers 354, 356, an analog audio video bus (AVB) 308 and a command bus 310, 
such as, for example, a PCI bus. According to the present invention, the AV Bus 308 enables 
the transport and routing of analog audio and/or video streams from analog sources at the 
input 302 to analog outputs at the output 304. The DVB bus 306 enables the transport and 
routing of digital audio and/or video streams from digital sources at the input 302 to digital 
outputs at the output 304. The CB bus 310 is the camera's internal bus, handing I/O 
operations, for example, to the different elements coupled thereto such as, for example, 
memory 350, DSP 348 and/or disk storage 352 (via an IDE bus, for example). The CB bus 
310 may include a PCI bus, an I2C bus, an IDE bus, a USB bus and/or and IEEE 1394 bus, to 
name a few illustrative (but not limiting) examples. The analog bus 308 may include one or 
more video decoder and encoder combinations, as shown at 328 and 330. For example, the 
decoder(s) 328 may include a PAL/NTSC and/or SECAM decoder(s), whereas the encoder(s) 
330 may likewise include a PAL/NTSC and/or SECAM encoder(s), to provide an encoded 
video stream to the output mux 356. An MPEGx (where x=2 or 4, for example) encoder 
takes the decoded output of decoder 328 or the digital video stream transported on the digital 
AV bus 308 and generates an MPEGx encoded output to a CPU 336, which may be or 
include a Pentium-class processor, for example. The CPU 336 may also be coupled to one or 
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more MPEGx decoders, which may also be coupled to the analog and digital buses 308, 306. 
The output of the CPU 336 may also be provided to the Command Bus 310. Both the 
decoder(s) 328 and the encoder(s) 330 may also be coupled to the Command Bus 310. A 
Main Input/Output control processor 340, together with AVB Scan 344 monitor and regulate 
5 the traffic on the three buses 306, 308 and 310. Indeed, the AVB Scan 344 functions as an 
automatic traffic regulator by informing the Main I/O control processor 340 of the current 
bandwidth transported on each of the busses 306, 308 and 310, thereby enabling the Main I/O 
control processor 340 to balance the bandwidths on each of the busses 306, 308 and 3 10. An 
analog to digital converter 338 takes the decoded analog output of the decoder 328 and feeds 
S 10 it to the Main I/O Control processor 340. Similarly, the output of the main I/O control 
m processor 340 may be converted to digital form by the analog to digital converter 342 and 

W output onto the Command Bus 310. The CPU 336 may also be coupled to the main I/O 

Ks| control processor 340. The output multiplexer 356 may be directly coupled to the input mux 

ji$ 354 by Mux Return Path 374. The input 302, according to the present invention, may include 

Sssfs 

HI 15 the output of a camera CCD 312, an ADSL input 314 (and/or other broadband network 

O 

connection), an IR (conforming, for example, to the IrDA protocol set out a www.irda.org) 
and/or Blue Tooth input 316 (and/or an output supporting an equivalent wireless short or long 
range communication protocol) and/or an external power jack 318. An internal source of 
power (such as internal lithium batteries 346) may also be provided. An auto-tracking analog 
20 controller 600 (as shown in Fig. 6), an I/O port 322, an IR Scanner 324 and an IR tag input 
326 may also be present at the input of the circuit. Other inputs may be added and/or 
substituted to the present invention, without, however, departing from the scope of the 
present invention, as those of skill in this art may realize. The output 304 may include one or 
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more HF TV outputs 358, one or more Y/C (S-Video) outputs 360 one or more HF data 
outputs 362 (coupled through the CB Bus 310, for example), and ADSL (and/or other 
broadband network connection), an IR output 366, a modem (such as a 56K modem, for 
example) 368 and a Blue Tooth-compatible output 370 (and/or an output supporting an 
equivalent wireless short or long range communication protocol). The shaded elements 320, 
322, 324, 326, 358, 360 and/or 362 may be made removable and disposed, for example, in 
one or more of the rings 408 shown in Fig. 4). This enables the video processing circuitry 
300 to be readily updated with removable elements that couple with the three internal buses 
306, 308 and/or 310. 

Fig. 4 is a perspective view of a standalone auto-tracking videoconferencing camera 
400 suitable for use in conjunction with the interactive TV device 502 of the present 
invention. The ornamental features of the videoconferencing camera 400 are disclosed in 
commonly assigned and co-pending US design patent application serial number 29/132,500 
and entitled "Videoconferencing Tracking Camera" filed on November 9, 2000, the 
disclosure of which is incorporated herein in its entirety. The auto-tracking camera 400, 
according to the embodiment illustrated in Fig. 4, includes a base 402 (shown as circular in 
Fig. 4), onto which one or more rings 408 may be stacked (one such ring being shown in Fig. 
4). The base 402 may include a connector 410 for power, video signal and/or control signals 
(such as the signals shown at 624, 626, 640 and 642 in Fig. 6). The ring or rings 408 may 
discharge various functions. For example, one ring 408 may include a battery to provide for 
up to three hours (for example) of autonomy for the standalone camera 400. Another ring 
408 may include a controller coupled to an electric motor for rotating the base 402 of the 
camera 400 along the X-axis 404. A third ring 408 may include HF communication means 
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and means for processing an analog and/or digital video stream, as detailed relative to Fig. 3. 
Additional rings 408 may be provided to support, for example, the Blue Tooth short range 
wireless specification. Such additional rings 408 may also support ADSL, may include a 
processor (from Intel Corporation, for example) to run a multipoint videoconferencing 
5 application under, for example, the Linux operating system. Over the ring(s) 408, the body 
portion 412 may incorporate an infrared (IR) sensor 416 and various (internal or external) 
antennas to enable the various modes of communication. The body portion 412 supports a 
head 418 that includes the optics of the camera 504 5 motors for moving the camera 504 along 
the X and Y-axes 404, 406 and stereo microphones 414. The optics (manufactured by 
S 10 Canon, for example), according to an embodiment of the videoconferencing camera 400, may 
yj advantageously be configured with auto focus, zoom (a 4:1 zoom, for example) and 

(y diaphragm functionalities that enable the videoconferencing camera 400 to select and center a 

l v target such as a person within a rectangular space of 1 m from a distance of 1 meter or to 

m center a person in a rectangular space of 1.5 m 2 from a distance of 5 meters. The 

Sj 15 videoconferencing camera 504 includes circuitry for creating an analog video stream and/or a 
W digital video stream (audio + video), as detailed relative to the block diagram of Fig. 3. 

Preferably, a Charge Coupled Device (CCD) imaging device within the camera 504 operates 
at less than 2 Lux to generate a High Definition TV- quality video stream. 

Fig. 5 is a block diagram illustrating a system 500 for interactive television and the 
20 manner in which various sources of information are presented to and acquired by the 
interactive TV device 502 of the present invention. As shown therein, the system 500 
includes the interactive TV device 502 coupled to a television or display 508. A keyboard 
518 may be removably coupled to the present interactive TV device 502, as may be a 
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pointing or input device, such as mouse 520. The ornamental features of the interactive 
television device 502 are further disclosed in commonly assigned and co-pending US design 
patent application number 29/132,949 entitled "Set-Top Box with Embedded Tracking Video 
Camera" filed on November 16, 2000, the disclosure of which is incorporated herein by 
5 reference in its entirety. The interactive TV device 502 may include an integrated disk reader 
and/or recorder 516, such as a CD-ROM or DVD player/recorder (such as, for example, a 
DVD-R, DVD-RW or DVD-RAM, for example), as well as a smart card reader 526 and/or a 
magnetic card reader 524 to enable users to insert and/or swipe credit, charge or debit cards 
within the device 502 to purchase goods and services online. The interactive TV device 502 
,f% 10 may also include an integrated camera 504, which is able to pan along both the X axis 404 
W and the Y axis 406 and to automatically track a target such as a speaker without resorting to 

analog to digital (A/D) and digital to analog (D/A) conversions and digital processing 

to 

techniques, as explained relative to Figs. 6 and 7. The device 502 may also include one or 

ill more microphones, such as shown at 522. To insure privacy when videoconferencing is not 

Si 15 desired, a cover 506 may be fitted over the front face of the interactive TV device 502 to 
Q 

^ physically obscure the field of view of the camera 504 by placing a physical opaque barrier 

over the optics of the camera 504. A similar cover may be configured to fit over the optics of 
the standalone video camera 400 of Fig. 4. 

According to the present invention, the interactive TV device 502 may also be 
20 coupled, via a network 510, to one or more servers 512. The server 512, in turn, may be 
coupled to a database 514. The database 514 may store information as to the availability of 
communications services, content providers and the like. Specifically, the database 514 may 
include records for Internet Service Providers (ISP), cable television providers, satellite 
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broadcast providers and records of all content providers that may be accessible and usable to 
the interactive TV device 502. According to one embodiment of the present invention, the 
interactive TV, upon initialization or periodically, may query the database 514 to determine 
what services are available to it and report to the user. Such a query (carried out by the 
5 localization general module 1102 shown at in Fig. 11) may provide the server 512 with the 
telephone area code of the location in which the interactive TV device 502 is deployed, 
whereupon the server 512 may retrieve the records of all service providers that provide 
services within that area code and return the information to the interactive TV device 502 to 
be displayed on the television or display 508 for the user. The user may then pick and choose 
S 10 which services he or she wishes to access or subscribe to. Alternatively, the interactive TV 
I ; y device 502 may provide the server 512 with the current time of day and the time zone of the 

IV location in which the device 502 is deployed. Alternatively still, other localization indicium 

i: ¥ or indicia may be provided to the server 5 12 to enable the server to appropriately formulate a 

{5 query (such as a Structured Query Language (SQL) query, for example) to the database 514 

\.J 15 to retrieve therefrom a list of available services. The interactive TV device 502 may also 
receive positioning signals (for example, from the Global Positioning Satellite (GPS) or 
GLONASS systems, for example) to fix its geographical coordinates, for example, to 
pinpoint its geographic location without any input form the user. This localization may be 
carried out completely anonymously or with a selectable degree of anonymity. The network 
20 510 may include the Internet, a dedicated broadband connection, satellite and/or cable, ADSL 
or most any other communication channel between the device 502 and the server 512. 

As is known, a video frame is composed of a series of successive scan lines that start 
at the top of the picture frame, after the generation of a frame pulse. The frame pulse enables 
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the synchronization of the offset of the scan lines from the top to the bottom of the picture 
frame, to precisely interlace two scanning fields of such scan lines. Each line starts from the 
left hand side of the picture frame after the top line signal. Each line is traced between 50 
and 65 (as and a frame lasts between 16 to 20 ms ? depending upon the prevailing video 
standard. Fig. 7 illustrates a videocomposite signal. The initial negative pulse (shown in Fig. 
7 as a 0.3 V amplitude square wave) represents the line synchronization that is immediately 
followed by a blank level and a black level It is from this black reference level that any rise 
in voltage corresponds to a lighter image until a maximum white level is reached. Frequency 
bursts are then superimposed upon this luminance signal to deliver the chrominance 
information of the videocomposite signal. 

Fig. 6 shows a block diagram of an auto-tracking analog controller 600 suitable for 
controlling the camera of the interactive TV box of the present invention. The controller 600 
enables the camera to automatically track and remain centered on a target (such as a person or 
a speaker in a conference room or a person in his or her living room watching TV) within a 
room along both the horizontal (X) and vertical axes (Y). According to the present invention, 
the camera 504 may be initially and grossly pointed to the target (e.g., person) by locating a 
selected and coded infrared signal emitted by an electronic badge or tag (shown in Fig. 13 at 
reference 1310) carried on the person. The electronic badge 1310 may include a selectively 
activated infrared transmitter configured to generate an IR signal that may be received by the 
IR sensor 416 or by an IR sensor on the interactive TV device 502. Both the interactive TV 
device 502 and the electronic badge may also include one or more microphones. Thereafter, 
the auto-tracking controller 600 of Fig. 6 will keep the person centered within the field of 
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view of the camera 504. Alternatively, the gross framing of the person using the electronic 
badge 1310 maybe omitted. 

The input signal 602 represents a videocomposite signal, as shown in Fig. 7. As the 
analog auto-tracking system of the present invention does not use the chrominance 
information, it may be filtered out, as shown at 604. The lines and a frames signals may then 
be separated by the synchro separator 606 and fed to separate outputs, labeled lines 608 and 
frames 160. It is the lines and frames signals 608, 610 that control the displacement of the 
camera 504 of the interactive TV device and of the camera 504 of the standalone analog auto- 
tracking camera 400 of the present invention, together with the videocomposite signal 602. 
As shown in Fig. 6, the auto-tracking analog controller 600 includes a horizontal 
displacement controller 612 that generates a move left signal 624 and a move right signal 626 
and a vertical displacement controller 628 that generates a move up signal 640 and a move 
down signal 642. Together, the move left signal 624, the move right signal 626, the move up 
signal 640 and the move down signal 642 fully control the displacement of the camera 504 of 
the interactive TV device and of the standalone auto-tracking camera 400 of the present 
invention. As shown in Fig. 6, the inputs to the horizontal displacement controller 612 
include the video in signal 602 and the lines signal 608. The lines signal 608 may be input 
into a current position counter 614, which counts the lines of the video signal 602. The video 
in signal 602 may be input into an outline analyzer 618. An outline (of a speaker, for 
example) may be determined, according to the present invention, by a transition in the 
amplitude of the luminance signal. This outline may be extracted from the video in signal 
602 by an analysis of the derivative of the luminance signal. To avoid errors in the outline 
analyses due to, for example, an alternating high contrast pattern on the speaker's clothing, 
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the output of the outline analyzer 618 may be fed into a correlator 616, which calculates the 
total energy of the signal and the position of the speaker by correlation. The output of the 
correlator 616 may also be input to the position counter 664, which assigns a number to the 
current position of the speaker. The output of the current position counter 614 may also be 
5 latched into the position - 1 module, which may be configured to store a value representative 
of the previous position of the speaker. Indeed, as the target person moves, the output of the 
current position counter 614 is a value that corresponds to the speaker's current position, 
whereas the position - 1 module 620 holds a value representative of the target person's 
previous position. By comparing the value within the position counter 664 with the value 

1 10 stored within the position - 1 module 620 in a comparator 622, it is possible to generate move 
W left and move right signals 624, 626 to control the movement of the camera 504 along the X- 

2 axis. Indeed, the camera 504 may be controlled to move to the left if the value representative 

17 of the previous position is greater than the value representative of the current position of the 

O 

li target person. Similarly, the camera 504 may be controlled to move to the right if the value 

N 15 representative of the previous position is less than the value representative of the current 

- position of the target person. 

The lines pulses 608 initialize the position analysis at the top left corner of the picture 
frame (the position of the scanning spot after the blanking interval). Each scan line of a 
frame may then be tested to determine the degree to which the target person may have moved 
20 in the horizontal direction. The test includes a determination of the outline of the target 
person from the envelope of the luminance signal corresponding to the person. Once the 
outline of the person has been determined, it is only necessary then to determine its offset 
relative to the line synchronization pulse to calculate the direction of the displacement of the 
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person. Indeed, if the offset between the top synchronization pulse and the beginning of the 
outline of the person is getting smaller, the person is moving toward the left and the move left 
output signal 624 may be asserted. In contrast, if the offset between the top synchronization 
pulse and the beginning of the person is getting larger, the speaker is moving toward the right 
side of the picture frame and the move right output signal 626 may be asserted. These signals 
624, 626 may be fed to the camera motor control system in real time to close the control loop 
and cause the camera 504 to follow the target person as he or she moves left or right. 

Turning now to vertical control, the frames signal 610 and the video in signal 602 are 
input to the vertical displacement controller 628, which has a structure that is similar to that 
of the horizontal displacement controller 612. The vertical displacement controller 628 
outputs the move up signal 640 and the move down signal 642, which signals are then fed in 
real time to the camera motor control system to close the control loop and cause the camera 
504 to follow the target person as he or she moves up or down. Indeed, if the offset between 
the top frame and the beginning of the outline as determined by the outline analyzer 634 and 
the correlator 632 diminishes, the person is moving up and if the offset increases, the person 
is moving down. This offset is determined by the difference between the current and the 
previous position of the person, as fed to the comparator 638 by the current position counter 
630 and the position - 1 module 636. 

Fig. 8 shows an embodiment of the user interface of an interactive TV device, 
according to an embodiment of the present invention. As shown therein, the display 802 of a 
television (or other display) 508 may be used in full screen mode or may be used in a 
configuration that includes one or more quarter screen segments 802a, 802b, 802c and 802d, 
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as shown. Each of the quarter screen segments 802a 5 802b 5 803c or 803d may display, for 
example, any combination of TV channels through one or more of the four independent 
television tuners (see reference numerals 112 in Fig. 1) of the interactive TV device of the 
present invention. Alternatively, the four quarter screen segments 802a, 802b, 803c and 
5 803 d may simultaneously display a combination of differently formatted video streams from 
a variety of providers. As shown in the illustrative example of Fig. 8, one of the quarter 
screens segments 802a, 802b, 803c and 803d may show a letterboxed movie as shown at 
802b, another quarter screen 802b may display a videoconference between users of like 
interactive TV devices and/or standalone auto-tracking videoconferencing cameras 400 (as 
S 10 shown in Figs. 4 and 13) as suggested by 802b, another quarter screen may display a 

y broadcast TV channel such as shown at 802c (a weather channel, for example) while yet 

ft 

fii another quarter screen may display a fully functional Web browser and a Web site rendered 

" y by a browser application loaded onto the device 502, as shown at 802d. 

CO The user interface of the interactive TV device of the present invention provides for a 

^ 15 pull out strip 804, 806, 808 and 810 along each side of the display 802. Such pull out strips 
may be normally invisible to the user during normal viewing. However, when pulled out by a 
pointing device (such as mouse 520 shown in Fig. 5) or another input device (including the 
user's voice, for example), the pull out strips 804, 806, 808 and 810 extend toward the 
opposite side of the display 802 from which they emerged to allow the user to fully control 
20 and program the operation of the present interactive TV device 502. The pull out strips 804, 
806, 808 and 810 are shown in the configuration of Fig. 8 only to avoid obscuring the display 
806 with overlapping strips. The pull out strips 804, 806, 808 and 810 may each include a 
plurality of icons 812, represented in Fig. 8 by the constituent squares making up each of the 
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pull out strips 804, 806, 808 and 810. Each of the icons 812, when clicked on by a pointing 
device 520 or selected by some other input device (including voice) may launch some 
application, provide the user with further choices and/or carry out some predetermined action 
or function. The icons 812 may be grouped according to functional categories. That is, icons 
812 in each of the pull out strips 804, 806, 808 and 810 may be functionally related. As 
shown in Fig. 8, the pull out strip 804 may reveal icons and/or information related to 
communications, the pull out strip 806 may reveal icons and/or information related to events 
management (recording of televised events, for example) and configuration and current state 
of the interactive TV device 502, pull out strip 808 may reveal icons and/or information 
related to user and profile management functions (creation, modification, deletion of users 
and user profiles and the access rights associated therewith) and pull out strip 810 may reveal 
icons and/or information related to available channels, including broadcast TV, cable TV, 
satellite TV and/or Web (Internet) channels, for example), resource (e.g., DVD) channel, 
camera channels or any video stream - from an auxiliary input, for example. Other functional 
assignments and distributions to the pull out strips 804, 806, 808 and 810 may be made, as 
those of skill in this art will readily recognize. The pull out strips 804, 806, 808 and 810 may 
be programmable, configurable and customizable. Not all pull out strips 804, 806, 808 and 
810 need reveal the same number of icons, nor must all icons be of the same size. Some 
icons may include logos, such as the logos of corporate broadcasters or personalized logos of 
users of the present invention (see, for example, Figs. 9 and 10). When selecting a pull out 
strip 804, 806, 808 or 810, the user may cause at least a portion of the display 802 to be at 
least partially obscured until the pull out strip 804, 806, 808 or 810 is released and collapses 
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into the side of the display 802 or otherwise disappears from the display 802 and the user's 
view. 

Fig. 9 shows an example of a pull out strip, according to an embodiment of the 
present invention. Such a pull out strip, as shown in Fig. 9, may be configured as above- 
5 mentioned pull out strip 810, and may reveal icons and/or information related to available 
channels (broadcast TV, cable TV, satellite TV, Web (Internet) channels, resource (e.g., 
DVD) channel, camera channels or any video stream - from an auxiliary input, for example). 
As shown the pull out strip may be divided into a first section 902 and a second section 904. 
As shown, the section 902 may include icons, such as shown at 910, 912 or 914. These icons 
i: 5 10 may be selected to configure the present interactive TV device or to otherwise carry out some 
predefined function. For example, the icon 910 may be selected by the user to adjust the 
m volume, icon 912 to mute the volume and icon 914 may cause playback to resume at a point 
a that is 30 minutes backward in time from the point in the playback. Other icons may be 

P related to the position of icons and/or logos on the pull out strip, blanking the display (for 

^ J 

^ 15 privacy, for example), adjusting the display characteristics and/or locking a display and/or 
channel, for example. The second section 904 may include a plurality of logos 908. Each 
logo may be selected by the user and may cause the display of the current program on the 
corresponding TV channel. The user may personalize logos and/or create entirely new logos 
for existing channels and/or services. According to an embodiment of the present invention, 
20 the pull out strips may include a zone that is visible when the strip is pulled out and an 
initially hidden zone 906 that is made visible when the user scrolls the strip. In this manner, 
an unlimited number of icons and/or logos may be represented in any of the pull out strips 
804, 806, 808 or 810. 



Page 35 of 70 



WEBE5753 



Fig. 10 shows an example of a pull out strip configured to manage users and user 
profiles, according to an embodiment of the present invention. Such a pull out strip may 
reveal icons and/or information related to user and profile management functions (creation, 
modification, deletion of users and user profiles and the access rights associated therewith), 
as discussed relative to pull out strip 808 above. Such a pull out strip 808 may include one 
or more icon sections 1002, 1016 and 1032 and one or more logo sections 1040. Logos 1042 
through 1050 show a picture of the users currently configured on the present interactive TV 
device. Each such user may log onto the present interactive TV device and individually 
define the configuration for the present interactive TV device (although choices may be 
deliberately restricted for some users, such as minors). This enables each user to personalize 
the device to their own liking and to enable parents to control the actions that their children 
(such as represented by logos 1048 and 1050) may take. For example, parents 1042 and/or 
1044 may lock out certain features of the device to their children 1048, 1050 (such as the 
videoconferencing feature, for example) and/or lock out certain channels. 

The icon 1004 of the icon section 1002 enables the currently logged on user to define 
their preferred security options, icon 1006 enables the currently logged on user to configure 
their IP connection, icon 1008 enables the user to configure broadcast and/or satellite TV 
channels, icon 1010 enables the user to set basic configuration features of the present device, 
icon 1012 enables the user to set advanced configuration features and icon 1014 enables the 
presently logged on user to edit their user profile. Icon section 1016 includes an icon 1018 
for configuring e-mail, an icon 1020 for configuring the videoconferencing settings, icon 
1022 for configuring chat settings, an icon 1024 for configuring the removable drawer (see 
Fig. 1 hatched items), an icon 1026 for configuring the states of the present interactive TV 
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device, an icon 1028 for network configuration settings, and an icon 1030 for configuring 
applications running and/or loaded on the present interactive TV device. Another icon 
section 1032 may include a validation icon 1034, a delete icon 1036 and a new user icon 
1038. The above-described icons are only exemplary in nature and those of skill in this art 
will realize that other icons or means of invoking the associated actions and/or functions are 
possible within the context of the present invention. A colored strip 1308 may be used to 
indicate to the user whether the various settings addressed by the icons are properly 
configured. The colored strip 1308 may, for example, be colored green if the settings are 
properly configured and may be colored red if one or more of the settings are not properly 
configured. Alternatively, the color of the strip 1308 may indicate whether horizontal 
scrolling is available in icon section 1016 (e.g., to reveal additional icons). Indeed, if the 
strip 1308 is a neutral color, no horizontal scrolling may be available (e.g., all icons are 
displayed in the icon section 1016 without the need to scroll), if the strip 1308 is green, left 
horizontal scrolling may be available to reveal other icons and if the strip 1308 is red, no 
further left horizontal scrolling may be available. 

By utilizing pull out strips, icons, logos, colored strips and scrolling such as described 
relative to Figs. 8, 9 and 10, a very intuitive, functional and compact user interface is created 
that may be controlled with a user-operated remote control unit that is provided with as few 
as three buttons and/or a trackball. A suitable remote control for the present invention is 
disclosed in commonly assigned and co-pending US Design patent application serial number 
29/141,046 filed on April 27, 2001 and entitled "Remote Control", the disclosure of which is 
incorporated herein in its entirety. 
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SOFTWARE ARCHITECTURE 

The present interactive TV device may be controlled by software that is preferably 
modular in design, in that the functions of the device are controlled by a plurality of software 
modules that may be dependent upon one another or independent of other modules. The 
control software may be loosely categorized in two groups; namely a first group that includes 
general modules and a second group that includes applications, of which the "Home" 
application is detailed below. The general modules are preferably independent of the 
applications, but provide for the requirements of existing and future applications, as well as 
the requirements of future hardware devices. The general modules are preferably designed so 
as to maximize the re-use thereof under an open source operating system, such as Linux. As 
shown in Fig. 11, the general modules include the localization general module 1102, the 
watchdog general module 1104, the application loader general module 1106, the logo 
management general module 1108, the user management general module 1110 and the 
channel configuration general module 1112. 

Localization General Module 

As detailed relative to Fig. 5, the localization general module 1102 enables the 
present interactive TV device to localize itself geographically (and, by extension, within the 
landscape of locally available service and content providers). This may be carried out by 
supplying some information such as telephone area code, time of day and time zone and the 
like to a server, such as shown at 512 in Fig. 5. The server 512 may then query a database or 
databases 514 to obtain therefrom information related to all locally available services and 
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content providers, which may then supplied to the present interactive TV device to initialize 
local values such as, for example, the URL of the relevant TV program listing server. 

Watchdog General Module 

The watchdog general module 1104 may be loaded onto the watchdog processor 
(shown at reference 134 in Fig. 1) to continually monitor the proper functioning and integrity 
of the present interactive TV device. The watchdog general module 1 104 may be configured 
to monitor some or all of the internal electronics and to signal any malfunction. The 
watchdog general module 1104 may also be configured to monitor and the integrity of the 
installed software and to re-generate, if necessary any software from an installation data 
carrier (e.g., CD ROM or DVD) while conserving any existing parameters (user parameters 
and profiles, logos, channel parameters, etc.). This module 1104 may also monitor the 
internal temperature of the interactive TV device (to optimize the operation of internal fans to 
conserve energy and reduce the device acoustics, among other reasons) and internal 
parameters, to detect and manage operating modes (sleep, and/or wake up operating modes, 
for example), to detect the presence of devices and/or signals, and to manage the camera 504 
integrated within the present interactive TV device. The watchdog general module 1 104 may 
also carry out control functions, to insure the continued confidentiality of user passwords and 
manage user profiles, for example. The watchdog general module 1 104 may also monitor the 
load present on the internals buses within the interactive TV device (such as the AV Bus 138 
and the Command bus 150 shown in Fig. 1, for example). The watchdog general module 
1104 may also generate alarms, in cooperation with various applications, when one of the 
buses 138, 150 becomes overloaded. Moreover, the watchdog general module 1104 and the 
processor 134 may discharge or otherwise interrupt a video signal that overloads a given bus. 
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Application Loader General Module 

The application loader general module 1 106 may be configured to load applications or 
other software modules onto the present interactive TV device by installing the application or 
software module from a local data carrier (such as a DVD loaded into the integrated disk 
reader and/or recorder 516 - see Fig. 5) and/or by downloading the application or software 
module from a server coupled to a network (such as shown at 510 in Fig. 5). The loading of 
an application or software module may be carried out in two phases. The first phase may 
include the loading and installation proper of the application or software module and the 
second phase may include a configuration and parameterization of the installed application 
and/or software module from the system data structures, discussed hereunder. 

Logo Management General Module 

The logo management general module 1108 enables the clipping of a logo from a 
Web site, the creation of an altogether new logo as well as the modification or deletion of an 
existing logo. This module, therefore, allows different users to create their own personal set 
of logos and to create their own personalized logos. Upon the creation of a new or modified 
logo, the logo management general module 1108 may automatically format the new or 
modified logo for use by the different applications. The logos may be stored as small graphic 
files and stored in a standard graphic format, such as the bitmapped .GIF format. Fig. 9 
shows examples of logos 908 that may have been clipped (cut, pasted and formatted) from a 
corporate Web site, using the logo management general module 1 108. 

User Management General Module 
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A user management general module 1110 loaded on the present interactive TV device 
enables the creation, modification and deletion of users and user profiles. According to the 
present invention, each user of the interactive TV device may be identified within the device 
by a unique user identification number (User ID). This user ID may be exclusively internal to 
the interactive TV device and may not be known to the user. According to an embodiment of 
the present invention, users may access their profile or profiles and/or login to the present 
interactive TV device by selecting their picture 1042, 1044, 1046, 1048 or 1050 
(alternatively, some other personalized graphic) from among the pictures of other users of the 
device, as shown in Fig. 12. Each of the user logos is associated with a unique user ID. Each 
user may be represented within the device by a distinctive logo (their picture, for example), in 
the same manner as a TV channel is represented by its own distinctive logo. According to an 
embodiment of the present invention, a user profile may be defined by and/or include one or 
more of the following: 

a) A user ID number, which may be assigned sequentially (for example, a 16-bit user 
ID number may provide for up to 64K users, although the present invention is not 
limited to 64K users); 

b) The user's logo, consisting of the user's photograph or other distinguishing 
graphic. This represents the link between the user and his or her profile; 

c) An identification of the last channel (cable, satellite, etc.) selected by the user; 

d) The number of channels defined for this user (from 1 to 979 channels from among 
the 64K possible channels, for example - although 64K channels is merely an 
exemplary and non-limiting number of possible channels); 
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e) The channel table, which includes the list of channels assigned to this user, 
together with its associated logo (note that two or more users may access to the 
same channel through different logos); 

f) The user's personal password, which enables the user to protect his or her profile 
from other users of the device. The user may also lock a recording from 
unauthorized access through the use of his or her password; 

g) The default recording quality for recordings made for this user. This default 
recording quality specifies the quality of any recording by this user unless 
overridden by the user or specified by the program to be recorded or some other 
source such as a programming guide, for example. The default recording quality 
may, for example, be one of three possible quality levels, such as "Film" (best 
quality recording), "Documentary" (medium recording quality) or "News" (lowest 
recording quality, and/or 

h) The user's applications table. This table defines the user's access rights to the 
applications loaded onto the present interactive TV device and the location of user 
and application-specific data. 

Channel Configuration General Module 

A channel configuration general module 1112 loaded on the present interactive TV 
device enables the configuration and management of channels. According to an embodiment 
of the present invention, the channels may be organized into four principal groups; namely, 
tuner channels, satellite channels, Web channels and resource channels, for example. The 
channels may have characteristics that are common to all channels across groups and 
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characteristics that are only associated with individual channels and/or to channels within a 
group. 

According to an embodiment of the present invention, the channel configuration 
information that is common to all channels across groups, according to an embodiment of the 
present invention, may include: 

A) The channel ID. The channel ID may be assigned sequentially and 
enables a unique identification of each channel within the device. This 
(16-bit, for example) number is preferably internal to the interactive 
TV device and unknown to the user. 

B) The channel type. The channel type information enables the 
identification of the type of channel and dictates the choice of software 
module that is used to initialize the channel. The type of channel 
information may be stored in a table, which may specify a number of 
channel types, such as tuner, VCR, DVD, Web, Camera, Auxiliary and 
Satellite, for example. 

C) The logo associated with the channel. The channel logo represents the 
link between the channel and the user. For the user, the channel logo 
identifies a channel (although the same logo may be associated with 
more than one channel). For example, each channel logo may be 
identified with a unique (32-bit, for example) logo identifier (logo ID); 

D) Personalized Settings. The personalized setting enable the user to 
modify various characteristics of the composite video signal, 
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including, for example, contrast, brightness, color saturation, tint, 
volume and the like. 

Channels of the "tuner" type enable the user to access analog video streams over the 
analog bus 138 (see Fig. 1). Each channel requires that one of the tuners (see reference 
numeral 108 in Fig. 1) of the present interactive TV device be tuned to a specific frequency. 
Each tuner channel is addressed by a channel number, which channel number associates a 
frequency range to a number. For example, when a user wishes to view CNN® and enters 
the channel number 20 for CNN®, the present device selects the optimum frequency for best 
reception within the range of frequencies for that channel number, in real time. . The 
information that is associated only with channels of the "tuner" type include the channel 
number, the source (e.g., cable or antenna), the country which, together with the channel type 
enables the determination of the frequencies of the available channels and the video format 
(e.g., NTSC, PAL or SECAM). 

Channels of the "Satellite" type are digital channels that may be accessible via the 
DVB bus (see bus 128 in Fig. 1). The information that is unique to satellite channels may 
include the address of the channel, the transponder to which the channel belongs and the 
video format of the channel (e.g., NTSC, PAL or SECAM). 

"Web" channels are digital channels that enable Internet access and display Web 
pages of specific Web servers. Once the Web channel is launched, Web channels allow Web 
surfing in the customary manner. The only information that is initially necessary is the 
Universal Resource Locator (URL) of the Web server of the desired homepage (which may 
be an offline homepage). 
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Channels of the type "Resource" belong to an umbrella category established to group 
all the remaining resources available to the present interactive TV device. These channels 
each have a unique resource channel identifier within a reserved range of 980 to 1001 (for 
example), which enables the present interactive device to distinguish between them and apply 
appropriate processing to each type of resource. A correspondence table may be provided to 
associate the resource channel identifiers with specific resources. For example, the resource 
channel identifiers may be allocated in the following manner: 980 to 989 reserved for Blue 
Tooth-enabled devices, 990 reserved for the camera channel (output from the camera 504), 
991 reserved for auxiliary devices, 997 for the PVR (personal video recorder configured to 
digitally record and store video on the disk storage 166 - see Fig. 1 - or other mass storage 
device), 998 for the DVD channel (video output form the integrated DVD player/recorder 
516) and resource channel identifier 1001 may be reserved for settings relative to the tuner 
and satellites channels. Other channel assignments may be made within the context of the 
present invention, as those of skill may recognize. 

Data Structures 

According to an embodiment of the present invention, the interactive TV device may 
operate upon four base indices. These base indices may include: 

1) a 16-bit (for example) channel ID base index 1 1 14 (for 64K possible channels 
of which the first 10 may be assigned automatically upon initialization of the 
device and sequentially thereafter); 

2) an 8-bit (for example) application ID base index 1116 (for a potential 255 
definable applications in the exemplary case wherein the application ID base 
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index is an 8-bit number, only one being shown in Fig. 11), wherein ID1 is 
preferably assigned to the "Home" application to be detailed below, ID2 is 
preferably assigned to a videoconferencing application as also detailed below, 
the remaining applications being assigned an application ID in a sequential 
manner; 

3) a 16-bit (for example) user ID base index 1118, assigned upon the addition of 
a new user, and 

4) a 32-bit (for example) logo ID base index 1120, assigned sequentially upon 
creating or obtaining a logo (by cutting a JPG logo from a corporate Web 
page, for example); 

From these four base indices, any combination of user, resource, channel and logo 
may be defined, to enable each user to utilize the resources of the present device and to 
personalize their interactive TV experience. Preferably, none of the four base indices 1 114, 
1 1 16, 1 1 18 and 1 120 include any application-specific information, to enable the applications 
to remain independent of the base indices and to utilize the base indices in any desired 
manner. 

The present interactive TV device may maintain a base data structure 1 128 containing 
general and current system information. The base data structure 1128 may include, for 
example, the User ID of the current user, the total number of assigned user IDs, the total 
number of assigned channel IDs, the total number of application IDs defined within the 
device, the system password, and general settings, such as contrast, brightness, hue, 
saturation and volume, for example. 
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As also shown in Fig. 11, the present interactive TV device may also include one or 
more application data structures 1126, each associated with an application 1130 loaded 
and/or running on the device. According to an embodiment of the present invention, each 
application data structure 1 126 may include information that is required by and specific to the 
associated application 1130. An application data structure 1 126 may include: 

a) an application number, which may be a chronologically and 
sequentially assigned unique number assigned at the time the 
associated application was installed; 

b) a description of the application, and 

c) any application-specific information. 

The present interactive TV device may also include a plurality of channel data 
structures 1124. According to the present invention, each of the resources available to the 
interactive TV device is utilized and treated as a channel. The channel data structures 1 124, 
therefor, describe the resources. Each channel data structure 1124 may include one or more 
(or all) of the following: 

a) the channel ID, which is a chronologically assigned channel identifier; 

b) the type of channel (tuner, satellite, PVR, DVD, Web, Camera, Auxiliary, for 
example); 

c) the logo associated with the channel; 

d) the address (e.g., frequency) of the channel and the multi-channel package to 
which the channel belongs; 
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e) the type of antenna (antenna or cable); 

f) the country for the tuner frequency range; 

g) the video format (e.g., NTSC, PAL, SECAM, etc.); 

h) personalized settings, such as contrast, brightness, hue, saturation, sound 
volume; 

i) the URL address associated with the channel (for Web channels). 

One or more of the available channels may be reserved and dedicated to specific 
resources, such as camera, auxiliary, DVD, PVR and/or settings, for example. 

Each application 1130 may manage its own user data structure 1122. This enables 
each application to manage its own data, to keep confidential private or business information 
secure, for example. Each user data structure may include one or more of the following: 



a) 


the user ID; 




b) 


the last used tuner channel; 




c) 


the number of channels defined for the user; 




d) 


the user's password; 




e) 


the user's default recording speed; 




f) 


the user's picture (managed in the same manner as a logo); 




g) 


the channel table (contains channel IDs and logos); 




h) 


the user's application table, including access authorizations and the address of 




the application and user-specific data. 
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THE HOME APPLICATION 

As shown in Fig. 12, the home application 1200 utilizes information contained in the 
data structures 1122, 1124, 1126 and 1128 and the base indices 1114, 1116, 1118 and 1120 
that are updated by the general modules 1106, 1108, 1110 and 1112. The home application 
enables the present interactive TV device to: 

a) display a tuner channel; 

b) display a satellite channel; 

c) display a video recording; 

d) display a DVD video; 

e) display a Web site; 

f) record a tuner channel; 

g) record a satellite channel; 

h) cause programmed events to execute; 

i) edit a video; 

j) carry out a videoconference. 

As shown in Fig. 12, the home application 1200 may include a master module 1218 
that controls a number of slave modules 1202-1216 as well as the resources 1220 available to 
the interactive TV device (keyboard 518, camera 504, cursor, DVD 516, pointing device 520 
etc.) and allocates them according to the requirements of the currently operating and/or future 
tasks. To insure an orderly operation of all of the tasks, the master module 1218 and the 
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slave modules 1202-1216 may communicate using a master-slave protocol wherein all 
communications are initiated by the master module 1218. The slave modules 1202-1216 may 
interact with one another, as may be the case wherein the slave module managing recordings 
(1210) interacts with the slave module that displays channels (1202). The interaction 
5 between slave modules, however, is preferably managed by the master module 1218. When 
an event occurs requiring a slave module 1202-1216, all of the information related to the 
event (from a keyboard 518, cursor or other resource) is received by the master module 1218 
which then sends all required information to the appropriate slave module(s) 1202-1216. 



As shown in Fig. 12, the home application 1200 may include the following: 




a) 



A channel display slave module 1202. Functionally, the channel 



display slave module 1202 analyzes the resource needs of a channel as 



a function of the channel type (e.g., tuner, satellite, DVD, Web, etc.). 



The channel display slave module 1202 then requests all necessary 



resources from the master module 1218 and configures the allocated 




resources to launch the channel on the display 802. The channel 



display slave module 1202 is called by all of the slave modules that 



must display a channel. 



A recording manager slave module 1204. This slave module manages 



the library of video recordings (copy, deletion, transfer to and from 



20 



disk 166, DVD-RAM, etc.), the selection of a recording and the launch 



of a playback of a previous recording. 
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A DVD manager slave module 1206. This slave modules enables the 
launch of a playback of a DVD disk and to manage all of the common 
functions of a DVD reader/recorder such as shown at 516 in Fig. 5, 
including menu, language, chapter, angle, up, down, left, right, valid, 
playback, fast forward, fast backward, pause, stop and slow motion, for 
example. This same module 1206 may also be invoked upon the 
playback and display of a digital recording (thereby providing the 
conventional PVR functions of playback, pause, fast-forward, etc.). 

A videoconference slave module 1216. This slave module manages 
the users (videoconference participants), establishes the video link 
with the remote videoconference participant(s), controls the local and 
remote camera(s) (such as shown at 504 in Figs. 4 and 5) and controls 
the video and audio streams to insure the success of the 
videoconference. 

An events manager slave module 1208. This slave module manages 
all current and future events within the present interactive TV device. 
The events manager slave module 1208 may access an events database 
1222 (or some other structure configured to store events information), 
which may include an entry for each current and future event carried 
out or to be carried out by the home application 1200 running on the 
present interactive TV device. The events database 1222 may, 
according to an embodiment of the present invention, store an event 
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ID, which is a chronologically-assigned number for each event, an 
indication of the type of event (display of a channel, recording of a 
channel, etc.), the frequency of the event, the start and end date and 
time of the event, the channel to record, the source and destination of 
the event (to copy a video stream, for example), the priority of the 
event, the speed of the recording, the user-owner of the event, the type 
of event, the password assigned to the event by the user and/or a 
description of the event, for example. 

f) A recording manager slave module 1210, which manages all 
recordings made on the present interactive TV device; 

g) A - 30 minutes manager slave module 1212, which enables, for 
example, the playback of a video stream to resume at a point in time 
that is 30 minutes prior to the current playback time (in effect, a 
function that plays back the last 30 minutes of video), and 

h) A video editor slave module 1214, which enables the user to edit a 
stored video stream using a full function video editor. 

The master module 1218 may also access a library database 1224 (or some other 
structure configured to store library information). The library database 1224 may be 
configured to enable the slave modules 1202-1216 and/or the master module 1218 to manage 
the video and/or sound recordings stored within the present interactive TV device. 
According to an embodiment of the present invention, the recording library database 1224 
may store an entry (a record in a table, for example) for each recording present within the 
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present within, accessible to (via an external drive, for example) and/or created by the present 
interactive TV device. Indeed, such recordings may be physically located within the device 
(on a magnetic hard disk drive such as shown at 166 in Fig. 1, for example) and/or on a 
compact disk or DVD-RAM recorded by the present interactive device. Alternatively still the 
library database 1224 may include entries of recordings stored at a remote location (such as a 
remote server) and accessible though a network, such as shown at 510 in Fig, 5. The library 
database 1224 may store, for each recording, the name of the recording, a description of the 
recording, the location (e.g., address) of the recording on the hard disk (see, for example 
reference 166 in Fig. 1), on a DVD-RAM and/or on the network 510 such as an Internet 
Protocol (IP) address on the network 510, the date of the recording, the time of the recording, 
the duration of the recording, the channel from which the recording was made, the user of the 
recording, the type of recording and/or the password (if any) associated with the recording, 
for example. 

Fig. 13 shows two participants A and B engaged in a videoconference utilizing the 
present interactive TV devices 502 and/or the auto-tracking videoconference camera 400 of 
the present invention. It is understood that participants A and B form no part of the present 
invention and are shown herein as stick figures for reference purposes only. As shown, an 
interactive TV device 502i is oriented facing participant A such that the auto-tracking camera 
504 thereof fixes videoconference participant A in its field of view. Similarly, the interactive 
TV device 502 2 or the auto-tracking camera 400 is disposed facing participant B. 
Participants A and B maybe geographically separated from one another, while the interactive 
TV device 502 2 or the auto-tracking camera 400 may be coupled to one another through a 
high speed connections to the network 510. The interactive TV device 502i is connected to a 
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display 508i while the interactive TV device 502 2 or the auto-tracking camera 400 is 
connected to a display 508 2 . By selecting the videoconferencing application (thereby 
invoking the videoconference slave module 1216 of Fig. 12), the users may carry out a full 
motion, real time videoconference. For example, user A may choose to use two quarter 
5 screen 1304 and 1306 of the display 508i to show images of user B and him or herself, 
respectively. The right-hand side of the display 508i may show a pull out strip 746 that 
displays icons and other information relevant to the configuration of the in-progress 
videoconference. A visual indicator on the pull out strip 746, such as the colored strip 1308 
may be provided to indicate, for example, that horizontal scrolling is available. Similarly, 
M 10 each of the quarter screens 1304 and 1306 may also include a visual indicator 1310 (such as a 
W thin colored strip) to indicate a properly configured connection between user A and user B. 
5 Alternatively, the visual indicator may inform the user of the state of the currently active 
; y quarter screen(s) by position and/or color, for example. For a recording for example, the 

5 visual indicator 1310 may be located to the left hand side of the quarter screen when the 

Si 15 recording is proceeding normally and may be located at the bottom of the quarter screen 
M when the recording is not proceeding normally. Alternatively still the colored strip 1308 may 

be green in color when the videoconference between users A and B is properly configured 
and may be turned to red when improperly configured, when excessive network traffic 
interferes with the videoconference or to indicate some other problem. Other combinations 
20 of strip position and/or color may be implemented within the context of the present invention. 
For example, audio signals may also alert the user of the state of any of the currently active 
quarter screens. Such visual indicators are preferably always visible, without any action by 
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the user. As shown at 5082, each participant may choose to view the other participant(s) in 
fall screen mode. 

The present invention and the system shown in Fig. 13 are also well suited to face-to- 
face videoconferencing activities within the ecommerce arena. Indeed, the present invention 
allows consumers to directly interface directly with real human (or virtual) representatives of 
online merchants for the purpose of ordering goods and services. Such applications are 
disclosed in co-pending and commonly assigned US patent application serial number 
09/514,041, entitled "Methods, Systems and Apparatus For Electronic Face-To-Face 
Business And Retail Brokerage" filed on February 25, 2000, the disclosure of which is hereby 
incorporated herein in its entirety. 

While the foregoing detailed description has described preferred embodiments of the 
present invention, it is to be understood that the above description is illustrative only and not 
limiting of the disclosed invention. Other modifications may occur to those of skill in this 
art. Thus, the present invention to be limited only by the claims as set forth below. 
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